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SUMMARY 


Intuitively,  one  thinks  of  a  search  problem  as  a  puzzle 
requiring  for  lto  solution  an  efficient  technique  or  algorithm 
for  locating  or  gaining  desirable  Information  about  come 
object.  The  object  may  be  a  physical  one  or  perhaps  purely 
mathematical  In  character. 

without  attempting  to  define  precisely  what  Is  meant  by 
a  search  problem  per  ce,  (this  we  leave  to  the  Logicians)  the 
author  illustrates  various  categories  and  aspecto,  e.g.,  game 
theoretic,  sequential  minimax,  etc.,  by  means  of  particular 
typical  problems  he  and  his  colleague  Selmer  Johnson,  et  al., 
have  solved  at  HAND. 
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SOME  SPECIAL  SEARCH  PROBLEMS 
0.  Gross 

Fellow  Researchers : 

If  one  were  to  make  some  3ort  of  snap  Judgment  on  the 
basis  of  the  title  of  the  talk  I'm  about  to  present,  per— 
haps  the  most  obvious  would  be  that  my  colleague  Dr.  Johnson 
and  I  are  qualified  specialists  In  the  field  of  search 
problems  (so  called),  and  indeed,  the  more  special  the 
problem  the  more  apt  we  are  to  solve  It.  Nothing  could  be 
farther  from  the  truth.  A3  a  matter  of  fact,  some  of  the 
problems  we  have  solved  are  quite  general  In  applicability, 
particularly  so  In  those  Instances  In  which  the  principle  of 
optimality  of  the  theory  of  Dynamic  Programming  13  used 
as  a  tool  to  facilitate  solution.  Another  counterexample 
to  thl3  specialist’’  theory,  at  least  Insofar  as  the  speaker 
Is  concerned,  13  furnished  by  his  complete  Inability  to 
solve  geographical  search  problems  of  the  most  elementary 
and  special  character.  In  fact,  hac.  It  not  been  for  the 
kind  graces  of  a  colleague,  who  furnished  his  transportation 
here,  he  never  would  have  been  able  to  find  this  place,  and 
you  would  have  been  spared  the  ordeal  of  listening  to 
his  babbling.  However,  the  very  fact  that  this  presentation 
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is  being  given  on  Columbu3  Day  lends  an  aura  of  appropriate¬ 
ness  to  the  title. 

Before  we  begin  discussing  our  various  examples,  a 
philosophical  digression  is  in  order.  Let  us  ask  ourselves 
the  following  question:  "What  constitutes  a  search  problem?1' 

I,  for  one,  profess  not  to  know  the  answer  to  this  question, 
nor  do  I  propose  to  formulate  a  precise  definition.  As  a 
matter  of  fact,  my  colleague  Selmer  Johnson  and  I  have  been 
knocking  our  head3  together  in  a  vain  attempt  to  do  so. 

Perhaps  the  reason  for  our  lack  of  success  stems  principally 
from  the  great  variety  of  aspects  and  kinds  of  Bearch  technique 
schizophrenia  and  other  kinds  of  limited  memory  constraints 
on  the  search  instruments,  uncertainty,  unreliability  of  in¬ 
formation,  animate  adversaries  attempting  to  withhold  infor¬ 
mation,  etc.,  that  can  be  Involved  in  a  seafch  problem. 
Apparently,  then,  any  definition  capable  of  encompassing  all 
or  any  of  these  aspects  would  be  either  too  special  or  too 
general. 

Consequently,  it  seems  advisable  to  leave  the  formulation 
of  a  definition  on  the  shoulders  of  the  Logician  and  content 
ourselves  with  our  intuitive  notion  as  an  acceptable  answer. 
(The  Logician,  of  course,  when  posed  the  question,  may  wave 
ni3  hands  in  a  despairing  gesture  and  exclaim,  "V/hy,  any 
mathematical  problem  is  a  search  problem — and,  indeed,  so  is 
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Mathematics  itself J") 

Well,  enough  for  this  digression. 

Intuitively,  however,  one  can  think  of  a  search  problem 
as  a  puzzle  requiring  for  its  solution  an  efficient  technique 
or  algorithm  for  locating  or  gaining  desirable  information 
about  3ome  object.  The  object  may  be  a  physical  one,  or 
perhaps,  purely  mathematical  in  character,  tacking  a  precise 
definition,  we  have  decided  to  classify  search  problems  Into 
two  broad  categories;  namely,  game  theoretic  and  non-game  theoretic. 
The  only  reason  for  this  type  of  breakdown,  aside  from  the 
speaker's  taste  for  game  theory,  is  that  the  problems  studied 
in  the  early  days  of  RAND  were  of  the  former  type,  specifically, 
two  person  zero  sum  games.  Unfortunately,  due  to  certain 
directives,  I  am  not  at  liberty  to  discuss  any  of  these. 

I  suppose  it's  time  to  illustrate  these  remarks  by  our 

first  example,  which  can  be  placed  in  either  category. 

With  R.  Bellman's  permission,  I  shall  quote  from  his 
RAND  paper  P— 1580  entitled  "The  Research  Frontier  ": 

"Problem  4.  Lost  in  the  woods 

"Suppose  that  we  parachute  into  a  large  forest 
whose  general  shape  and  dimensions  we  know  pre¬ 
cisely.  If,  however,  we  do  not  know  where  we  are 
in  the  foreEt,  and  can  locate  no  point  exactly 

until  we  reach  the  boundary,  how  do  we  get  out  of 

the  forest  as  quickly  as  possible?" 
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Admittedly  the  foregoing  question  is  at  best  an  Incomplete 
formulation  of  a  class  of  mathematical  problems,  but,  perhaps, 
purposely  so  in  order  to  provoke  effort  on  the  part  of  the 
speaker  and  others  toward  the  formulation  and  solution  of 
meaningful  interpretations.  Now,  two  different  interpretations 
are  readily  suggested: 

Interpretation  No.  1  Game  Theoretic 

A  pure  strategy  for  player  I  is  a  covering  of  the  origin 
of  the  Euclidean  plane  by  a  closed  figure  of  given  shape  and 
size. 

A  pure  strategy  for  player  II  (who  i3  unaware  of  the 
result  of  I' s  choice)  consists  of  any  pure  continuous  decision 
method  leading  him  to  a  directed  rectifiable  arc  starting  at 
the  origin  and  terminating  at  the  first  point  it  touches  on  the 
boundary  of  the  figure  placed  by  player  I. 

The  payoff  from  II  to  I  is  then  the  length  of  the  path 
thus  obtained. 

Interpretation  No.  2  Mln&iax 

Find  a  shortest  directed  plane  rectifiable  arc  with  the 
property  that  if  the  origin  of  the  arc  is  covered  in  any  way 
by  a  given  closed  plane  figure,  some  point  of  the  arc  lies  on 
the  boundary  of  the  figure.  (We  remark  that  certain  figures 
of  infinite  extent  do  not  apply  here;  for  example,  a  half- 
space.  On  the  other  hand,  an  infinite  strip  of  unit  width 
does . ) 
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As  our  example,  consider  the  case  in  which  the  forest  is 
a  circular  disc  of  unit  diameter.  As  far  as  the  game  theoretic 
interpretation  is  concerned,  it  is  a  trivial  exercise  to  verify 
that : 

The  unique  optimal  strategy  for  player  I  is  to  center 
the  circle  at  the  origin. 

There  are  many  optimal  strategies  for  player  II  (the 
searcher)  but  all  of  them  (in  view  of  player  I's  strategy) 
involve  mixing  on  an  initial  direction  and  heading  out 
thereafter  in  a  straight  line.  For  example,  mixing  equally 
on  a  choice  of  north  and  south  is  optimal.  Choosing  a 
direction  0  from  the  uniform  distribution  over  [p,  2v\  is 
also  optimal. 

The  value  of  the  game  is,  of  course,  the  radius  of  the 
circle,  i.e.,  1/2. 

The  minimax  solution  for  the  circular  forest  is  unique 
and  is  simply  a  straight  line  segment  of  unit  length.  This 
also  is  a  trivial  exercise.  You  observe,  however,  that  the 
solutions  for  the  two  interpretations  of  the  circular  forest 
problem  are  essentially  different. 

Por  other  examples  and  solutions  of  the  forest  problem, 
we  refer  you  to  "A  Search  Problem  due  to  Bellman,"  RAND 
research  memorandum  RM— 1605  by  0.  Cros3. 

So  much  for  the  forest  problem. 
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Our  next  three  examples  are  non— game  theoretic,  and,  in 
fact,  devoid  of  random  elements.  They  do,  hov/ever,  display 
the  minimax  character  mentioned  earlier. 

I  shall  quote  from  a  paper  by  Lester  Ford,  Jr.  and  Selmer 
Johnson.  The  paper  is  entitled  "A  Tournament  Problem"  and 
appeared  in  the  May  1959  issue  of  the  American  Math.  Monthly. 

"In  his  book,  'Mathematical  Snapshots', 

Steinhaus  discusses  the  problem  of  ranking  n  objects 
according  to  some  transitive  characteristic,  by 
means  of  successive  pairwise  comparisons.  In  this 
paper  we  shall  adopt  the  terminology  of  a  tennis 
tournament  by  n  players .  The  ^problem  may  be  briefly 
stated:  'What  is  the  smallest  number  of  matches 

that  will  always  suffice  to  rank  all  n  players? ' 

'Steinhaus  proposes  an  Inductive  method  whereby, 
the  first  k  players  having  bden  ranked,  the  k  +  1— et 
player  is  matched  against  a  median  player  in  the 
first  k  and  by  a  'halving'  process  is  finally  ranked 
into  this  chain.  Then  the  (k  +  2)-nd  player  is 
ranked  into  the  new  chain  of  k  +  1  players  in  the 
3ame  manner. ' 

Steinhaus  then  asserts,  'It  has  not  been  proved  that 
there  is  no  shorter  proceeding  possible,  but  we  rather  think 
it  to  be  true." 

Steinhaus  was  wrong  in  his  conjecture,  in  fact  for  all 
n  >  4,  as  the  results  of  Ford  and  Johnson  show.  Their  technique 
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la  quite  engenious,  but  I  would  rather  refer  you  to  their 
paper  for  the  details.  Suffice  it  to  say  that,  although  the 
authors  cannot  honestly  assert  that  their  method  is  optimal 
for  all  n  (this  is  unknown)  they  have  verified  optimality  up 
to  n  *  11  and  for  n  «=  20  and  21  as  well.  At  any  rate,  their 
bound  is  an  improvement  over  Steinhaus's  for  comparatively 
small  n,  and  even  asymptotically  . . . 

Our  next  example  deals  with  a  result  obtained  independently 
by  Selmer  Johnson  and  J.  Kiefer.  Although  Kiefer's  work 
antedates  Johnson's,  it  is  somewhat  abstract  by  comparison, 
and  lacks  the  straightforward  simplicity  of  Johnson's  paper. 

Consequently,  I  shall  quote  from  his  RAND  paper  P-856, 
which  bears  the  resounding  title  "Best  Exploration  for  Maximum 
is  Pibonaccian" . 

"Definition:  A  function  f(x)  is  unlmodal  if  there 
is  an  xQ  such  that  f  is  either  strictly  increasing 
for  x  £  x  and  strictly  decreasing  for  x  >  x  ,  or 

V  V* 

else  strictly  increasing  for  x  <  xQ  and  strictly 
decreasing  for  x  ^  xQ. 

"For  example,  concave  functions  are  unimodal." 

The  main  results  of  this  paper  read  as  follows : 

Theorem  1.  Let  y  =  f(x)  be  any  unimodal  function 

defined  on  an  interval  0  <  x  <(  L  .  Let  P  =  the  supremum 

n  n 

of  all  Ln  with  the  property  that  we  can  always  locate 
the  maximum  of  f(x)  to  within  a  unit  length  sub— interval 
by  appropriate  calculation  of  n  value  of  the  function. 
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Then  Fn  13  the  n-th  Fibonacci  number,  that  is  PQ  =  =  1 

and  F  0  =  ?  ,  +  F  . 

n  +  d  n  +  l  n 

Theorem  2.  (The  discrete  case)  Let  y  =  f(x)  be 

any  unimodal  function  defined  on  a  discrete  set  of  Hn 

points.  Let  K  =  maximum  of  all  H  such  that  the 

n  n 

function's  maximum  can  be  identified  in  n  observations. 

Then  K„  "  Pn  +  1  -  1<  n  ]>  1. 

Those  of  you  who  are  interested  in  pursuing  these  results 
further  are  referred  to  Johnson's  paper. 

I  should  like  to  remark,  however,  that  extensions  of  this 
type  of  minimax  result  to  the  important  multidimensional  cases 
seem  extremely  difficult  to  obtain  and,  to  our  knowledge,  do 
not  exist  in  the  literature. 

The  next  example  we  shall  discuss  is  gleaned  from  a  Joint 
paper  by  Johnson  and  me,  entitled  "Sequential  Minimax  Search 

for  a  Zero  of  a  Convex  Function".  This  paper  originated  at 

$ 

RAND  and  later  appeared  in  a  somewhat  digested  form  in  the 
January  1959  issue  of  MTAC. 

The  problem  we  proposed  to  solve  can  be  stated  as 
follows : 

tfe  know  initially  a  positive  and  a  negative  value  of  a 
function  at  two  given  points.  The  function  is  continuous  and 
convex  and  is  otherwise  unknown  but  computable.  Oiven  a 
positive  integer  n,  how  can  we  locate  the  bracketed  zero  of 
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the  function  to  within  an  interval  of  minimal  guaranteeable 
length  in  n  evaluations  of  the  function? 

Unfortunately,  the  algorithm  which  expresses  the  solution 
of  this  problem  is  somewhat  complicated,  but  not  inordinately 
so.  The  important  point,  however,  which  we  wish  to  bring  out 
as  the  salient  feature  of  this  problem  and  which  is  to  be 
shared  with  others  of  its  kind,  is  the  following: 

The  problem  requires  using  an  algorithm  to  find  an 
algorithm  which  solves  the  problem.  To  be  more  specific,  the 
information  structure  of  the  problem,  together  with  dominance 
considerations,  enabled  the  proposers  to  invoke  the  principle 
of  optimality  of  the  theory  of  Dynamic  Programming.  A 
functional  equation  was  thus  set  up.  The  recursive  solution 
of  the  functional  equation  was  accomplished  numerically  on 
an  electronic  digital  computer  for  n  =  1,  2,  3,  4.  Reference 
to  the  tabular  data  thu3  obtained  then  constitutes  part  of  the 
algorithm  described  as  the  solution  to  the  problem. 

Of  course,  the  recursive  evaluation  of  the  solution  of  the 
functional  equation  posed  a  search  problem  in  its  own  right. 
But,  since  it  was  not  a  critical  one,  the  proposers  did  not 
require  any  high  degree  of  efficiency  in  its  solution.  (The 
Logician  might  blurt  out  at  this  point,  'I  told  you  soJ")  ... 

We  shall  now  turn  our  attention  to  a  search  game  proposed 
by  Professor  David  Qale  of  Brown  University.  He  and  I  sub¬ 
sequently  solved  this  game,  although  the  solution  and  its 
verification  are  at  present  unavailable  in  any  published  form. 
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The  game  can  be  Interpreted  as  a  game  over  function 
3pace  and  Is  described  thu3 : 

Player  I,  the  maximizer,  la  In  possession  of  one  unit  of 
volume  of  some  valuable  product.  There  are  two  holes  1  and 
2  of  depths  dj  and  dg,  respectively  and  of  unit  cro3s-eectlon. 

To  play  the  game,  I  levels  his  product  In  the  bottom  of  the 
holes,  l.e.,  he  either  hides  all  of  It  In  one  of  the  holes  or 
divides  It  Into  two  closed  parts  x^  Xg,  with  Xj  >  0,  x^  +  x?  *  1, 
and  hides  x1  In  hole  1  and  Xg  In  hole  2.  The  holes  are  now 
filled  to  ground  level  with  opaque  dirt,  whereupon  player  II, 
the  mlnimizer,  enters  the  scene.  II  knows,  of  course,  the 
locations  and  corresponding  depths  of  the  holes,  but  aside  from 
the  rules  of  the  game  Is  Ignorant  of  I's  choice.  It  is  now  up 
to  II  to  uncover  the  loot  by  removing  dirt  from  the  holes  In 
level  layers  according  to  some  digging  scheme.  Player  II  stops 
digging  as  soon  as  he  sees  pay  dirt,  whereupon  he  pays  to 
player  I  an  amount  proportional  to  the  volume  of  dirt  he  has 
removed  from  the  holes. 

The  most  Interesting  case  13,  apoarently,  the  one  In  which 
both  holes  have  depths  exceeding  unity,  dale  and  I  were  able 
to  verify  that,  for  this  case,  the  following  describes  a 
solution  to  the  game : 

An  optimal  strategy  for  player  I  consists  of  his  behaving 
as  follows: 

He  hides  his  entire  unit  In  hole  1  or  In  hole  2,  or,  he 
partitions  his  unit  In  the  two  holes  according  to  the  uniform 
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distribution  over  the  unit  Interval;  the  respective  probabili¬ 
ties  of  these  three  events  being  proportional  to  the  three 
numbers,  d^  —  1,  d^  —  1  and  1. 

Player  II  (the  searcher)  has  an  optimal  strategy  Involving 
mixing  on  four  paths;  namely: 

(A)  Dig  hole  1  to  bottom  and  then  3witch  to  hole  2; 

(B)  Dig  hole  2  to  bottom  and  then  switch  to  hole  1; 

(C)  Dig  hole  1  to  depth  d^  —  1  cfnd  switch;  or,  finally, 

(D)  Dig  hole  2  to  depth  dn  -  1  and  switch. 

The  respective  probaoillties  of  these  4  digging  schemes 
are  proportional  to  the  four  numbers  d^,  d^,  d^  —  1  and  d^  —  1. 

The  value  of  the  game  is  expressible  as  a  rational  function 
of  the  two  depths. 

We  dispense  with  this  oddity  by  remarking  that  the  searcher 
in  this  game  ha3  more  than  one  optimal  strategy’.  The  unique¬ 
ness  question  for  the  hider  has  not  been  resolved. 

You  will  undoubtedly  be  pleased  to  learn  that  I  have  only 
two  more  examples  left  to  discuss.  Both  of  them  are  non-game 
theoretic.  They  are,  however,  statistical  in  nature,  in  that 
the  random  elements  are  outside  the  control  of  the  searcher 
who,  moreover,  is  assumed  to  be  a  perfectly  reliable  observer. 
The  a  priori  distributions  of  the  random  elements  are  assumed 
known  and  unalterable. 

Perhaps  the  distinguishing  feature  of  this  type  of  search 
problem  is  that  the  searcher  need  not  resort  to  using  any 
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random  devices  of  his  own  making,  for  conducting  the  search. 

No  such  device  could  possibly  enhance  his  expectation.  (in¬ 
cidentally,  this  la3t  remark  is  not  intended  tc  3quelch  any 
Monte  Carlo  enthusiasts  present). 

The  simpler  of  the  two  examples  i3  described  in  a  RAND 
memorandum  RM— 1652,  March  1956  by  Johnson.  ''Optimal  Sequential 
Testing''  is  the  title.  With  your  leave  I  3hall  quote  from 
the  Introduction:  (TV  servicemen  kindly  take  note.) 

'A  complicated  machine,  for  example,  a  radar 
set,  which  consists  of  many  components  each  having 
many  parts,  is  not  working  because  of  failure  of 
some  of  its  components.  In  what  sequence  should 
its  components  and  part3  be  tested  and  repaired  in 
order  to  minimise  the  expected  delay  time  before 
it  is  working  again?' 

Johnson  solves  this  problem  under  various  realistic 
assumptions  about  the  machine  composition,  testing  times,  etc. 

The  only  comment  I  shall  make,  however,  i3  that,  although 
quite  a  few  parameters  enter  into  the  various  models  described 
In  the  paper,  the  optimal  test  sequence  in  each  case  is  cal¬ 
culated  by  an  absurdly  simple  ordering.  Save  for  the  item  to 
be  tested  last,  the  Items  are  ordered  according  to  the 
algebraic  ordering  of  the  values  of  simple  rational  functions 
of  the  parameters  involved.  The  item  to  be  placed  last  is 
determined  by  a  minor  calculation  and  shifted  to  the  end. 

For  the  exact  details,  I  refer  you  to  Johnson's  paper... 
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As  our  final  example  of  a  search  problem,  or  rather  a  class 
of  such,  I  recommend  a  paper  which  appeared  In  the  Annals  of 
Mathematical  Statistics,  December  1956.  The  paper  has  a 
trio  of  authors,  R.  N.  Bradt,  Selmer  Johnson,  and 
Sam  Karlin,  and  Is  entitled  'On  Sequential  Designs  for  Maximiz¬ 
ing  the  Sum  of  n  Observations'. 

The  main  theorms  of  this  work  are.  In  effect,  statements 
about  optimal  sequential  designs  for  various  generalizations 
and  concomitant  cases  of  the  so  called  '2— armed  bandit  problem'. 

I  shan't  bore  you  with  any  mathematical  details,  but  merely 
give  a  quotation,  as  usual: 

"The  type  of  problem  known  as  the  'two— armed 
bandit'  Is  a  special  case  of  the  preceding.  In  Its 
'classical'  formulation  (whence  the  name),  we  have 
a  slot  machine  with  two  arms,  an  x— arm  and  a  y-arm. 
When  either  arm  Is  pulled,  the  machine  pays  off 
either  one  unit  or  nothing;  and  the  probability 
of  winning  with  one  arm  is  p  and  the  other,  q.  A 
priori  it  is  unknown  which  Is  which,  but  the  pro¬ 
bability  5  that  it  Is  the  x— arm  which  has  probability 
p  of  success  Is  assumed  loiown.  One  is  allowed  n 
play3,  and  a  sequential  design,  or  strategy,  is 
desired  which  will  maximize  the  expected  winnings. 

"It  ha3  been  conjectured  for  this  problem  that 
the  optimal  strategy  Is  :  (namely)  on  each 
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play  choo3e  the  arm  having,  at  that  time,  the 
maximum  expected  probability  of  paying  off,  i.e., 
play  each  time  as  though  there  were  but  one  play 
remaining.  This  conjecture  has  been  verified  to 
hold  for  n  £  8. " 

It  has  been  shown,  by  the  way,  that  the  same  conjecture 
as  the  foregoing  i3  false  when  applied  to  general lzatlon3 
of  the  two-armed  bandit  problem,  i.e.,  is*  in  general ,  not 

optimal . 

At  any  rate,  I  suggest  you  read  the  paper  very  carefully 
before  considering  a  trip  to  ''Vegas  '. 

Before  closing,  I  should  like  to  make  a  philosophical 
comment  about  statistical  type  non-game  theoretic  search  problems 
like  the  two  preceding.  In  certain  instances  statisticians 
have  been  unable  to  assign  a  priori  distributions  when  faced 
with  ’real  world"  problems  of  thi3  kind.  In  the  fairly  recent 
past  when  game  theory  was  the  "coming  thing'',  it  had  been  the 
tendency  for  some  statisticians  to  quantify  out  the  unknown 
distributions  by  resorting  to  playing  a  game  against  Nature 
and  thus  to  obtain  a  certain  type  of  distribution— free  result; 
they  would  tacitly  recommend,  for  example,  recourse  to  tables 
of  random  numbers,  in  playing  some  of  their  games.  The  implica¬ 
tion  Is  obvious.  Nature  is  their  enemy;  hence  they  should  be 
careful  to  avoid  using  RAND's  table  of  random  digits,  which 
were  generated  by  Nature. 

I  do  not  know  whether  this  kind  of  hedging  i*  still  in 
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vogue  .  At  best  it  Is  contrary  to  my  religious  beliefs  .  .  . 

Although  this  talk  ha3  been  too  long  already,  we  are 
forced  to  admit  that  we  have  just  barely  touched  upon  but  a 
few  of  the  manifold  elements  that  can  appropriately  be  called 
'Ingredients'1  of  a  Bearch  problem.  We  hope,  however,  that 
you  have  gleaned  some  idea  of  our  intuitive  notion  thereof, 
by  way  of  the  melange  of  examples  presented. 

Thank  you  for  your  kind  attention. 


*A  poll  of  at  least  one  statistician  indicates  that  it  is  not. 
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